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Abstract 

Applying the replica method of statistical mechanics, we evaluate 
the eigenvalue density of the large random matrix (sample covariance 
matrix) of the form J = A 1 - A, where A is an M x N real sparse 
random matrix. The difference from a dense random matrix is the 
most significant in the tail region of the spectrum. We compare the 
results of several approximation schemes, focusing on the behavior in 
the tail region. 
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1 Introduction 

Investigation on sample covariance matrices has a long history. It was orig- 
inally introduced in multivariate statistical analysis pQ. Let us consider N 
dimensional sample vectors X^ m \ m— 1, 2, ■ • ■ , L, where L is the number of 
samples. The sample covariance matrix S is then denned as 

Sji = t^t E (*j m) - *i)(*/ m) - *i)> (l-l) 

L ~ 1 m=l 
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where the sample mean vector X is 

1 L 

X = -Y J X {m) . (1.2) 

L m=l 

Let us suppose that X^ are random vectors: the components Xj m \ j = 
1, 2, • • •, N, are independent and identically distributed Gaussian random 
variables. Then the distribution of (L — 1)S is the same as the distribution 
of the N x N matrix 

J = A T A (1.3) 

(A T is the transpose of A), where the elements of the (L — 1) xiV matrix A 
are independent and identically distributed Gaussian random variables. The 
ensemble of sample covariance matrices is sometimes called "chiral Gaussian" 
or "Laguerre" ensemble and finds applications in neural- network learning [2] , 
quantum chromodynamics [3], mesoscopic physics [I], finance [51 [6] and wire- 
less communication [TJ. 

In multivariate statistics one is usually interested in the limit L — > oo 
with fixed iV. On the other hand, motivated by Wigner's celebrated work [5] 
on real symmetric random matrices, Marcenko and Pastur studied another 
limit N, L —>■ oo with L/N — > a (0 < a < 1) and derived the asymptotic 
density for the scaled eigenvalues of J as 0, [TO] 

p(x) = (1 - a)5(x) + ^-J(x - (v^ - 1) 2 )((V^ + I) 2 - z). (1.4) 

2irx 

This asymptotic result is valid for more general distributions of the matrix 
A, and is sometimes called Marcenko-Pastur law. 

One of the simplest ways to modify the random matrix J so that Marcenko- 
Pastur law breaks down is to make the matrix A sparse. An example demon- 
strating the significance of considering random matrix ensembles defined on 
the basis of sparse A can be found in communication theory: Information- 
theoretic channel capacity of a randomly-spread Code-Division Multiple- 
Access (CDMA) channel is evaluated in terms of eigenvalue distribution 
of the matrix J = A T A with A defining the random spreading. It has 
been argued [UJ that some wideband CDMA schemes can be modeled as 
a sparsely-spread system, where deviations from Marcenko-Pastur law may 
affect performance of such systems. Sparse random matrices in general are 
also of interest in many branches of applications. In particular, the eigen- 
vector localization expected to occur in sparse random matrices is one of 
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the most outstanding phenomena in disordered systems. The appearance of 
isolated eigenvalue spectra in the tail region is another interesting feature. 
Such features are also observed in heavy-tailed random matrices and were 
recently studied in detail [121 1151 113] . 

In this paper, as a continuation of a brief report by one of the authors [15] , 
we investigate the spectral (eigenvalue) density of sparse sample covariance 
matrices. In the case of real symmetric sparse random matrices R whose 
elements Rji (J < I) are independently distributed, the asymptotic spectral 
density was already studied by several authors [HI [T71 HI [19] . Field theoretic 
(replica and supersymmetry) methods were usually employed. For example, 
Semerjian and Cugliandolo utilized a sophisticated version of replica method 
and discussed the spectral density in connection with the percolation prob- 
lem [19J. In the next section, we present a similar replica method developed 
for the analysis of sparse sample covariance matrices. In §3 and §4, the 
effective medium approximation (EMA) and its symmetrized version are in- 
troduced. In §5, we consider the case of binary distribution and evaluate the 
asymptotic spectral density. In §6, the tail behavior of the spectral density is 
analyzed by means of the single defect approximation (SDA), which improves 
the symmetrized version of EMA. 



We are interested in the asymptotic spectral density of the N x N matrix 



where A is an M x N real sparse random matrix(M < N). The elements 
of A are independently distributed according to the probability distribution 
function 



with a fixed positive number p < N. Here S(x) is Dirac's delta function. The 
asymptotic limit N — > oo with p and a = M/N fixed will be considered. We 
assume that U(x) does not depend on N and has zero measure on the origin: 



2 Replica Method 



J = A T A } 



(2.1) 




(2.2) 




(2.3) 
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The Fourier transform of P(x) is given by 

p(k) = y°° P(x) e~ ikx dx = 1 + j^f(k), (2.4) 
where _ 

/oo 

U(x) e~ ikx dx- 1. (2.5) 
-oo 

Let us denote the average over MN copies of P(x) by brackets (•). Then 
the average spectral density of J is defined as 

pM = ^E^-^-))» ( 2 - 6 ) 

where /ii, /i2, • • • , (J>n are the eigenvalues of J. We can rewrite p(fj) as 

p(/i) = ^l-ImTr^J-^ + k)/)- 1 ) 
2 9 

-Im— (lnZ(/x + ie)) , (2.7) 



iVvr <9/i 

where / is an N x N identity matrix, e is a positive infinitesimal number and 
r N iia' N i N N 1 

z{p!) = / n «p{-g-x;^-9EE h ^ = ^ + <e ( 2 - 8 ) 

is called the partition function. In order to evaluate the average over P(x), 
using the relation 

d 



we deduce 



Thus we find that the spectral density can be written in terms of the average 
(Z n ). 
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Noting 

M ( ■ M ( N \ / TV \) 

y n^exp jgEl^-E^j m-E^«j =m m/2 , 

(2.11) 

we find 

^5 y II d ^fc exp | - J] ^ - i E E ^M*^. 



(27Ti) M / 2 



J 

k=l I ^ fc=l fc=l 3=1 



( i M N N \ ( i N N } 

= ex p { - o E E E 0j^fcj0/^fc/ r = ex p ^ - 9 E E > » 

[ Z fc=lj=U=l J [ Z j=H=l ) 

(2.12) 

from which it follows that 

N M I • / N ■ M 



!M V I 

-*EE^Vi ■ (2.13) 
fc=ii=i j 

Now we introduce the vectors (replica variables) 

fi = (4>?\ 4>f\ • • • , A = (tf \ (2.14) 
and the corresponding measures 

d£- = d^dtff • • • d0$ n) , d^ fc = d^Wf • • • d^ n) (2.15) 
so that the average (Z n ) can be rewritten as 

N M \ • / N ■ M 



M V 

x ( exp \ -i 53 53 A fej ^fc • 0i }> ) , (2.16) 
fc=ij=i 



where = <pj ■ <pj and tfl = ^ • 



Using the Fourier transform (12.41) of the probability distribution function 
P(x), we obtain 



M N 

exp {-i^2^2 A kj tf k ■ <pj 
k=ij=i 



M N 



I] II / dxP(x) exp ■ fax} 

M N ( V - - 1 

nn«p (2.i7) 

fe=lj = l UV J 



in the limit N oo. It follows that 



r N - M - hV ^ - i M - 

/n^nd^exp rfz^z^ 

J j=l k=l I Z i=l z fc=l 



iv fc=li=l 



M AT 



(2.18) 



3 Effective Medium Approximation 

We are in a position to explain how to evaluate the spectral density by means 
of a scheme called the effective medium approximation (EM A) [TU] . We first 
rewrite (12.181) as 



,/ N 



? \ /9 /d^expj Ift + Ljhftf 
(27ri) n / 2 J r F \2 r N 



M 



Introducing 



TV 



«0 = Tp£W-fc). 



(3.1) 



(3.2) 



we find 



iV 



nd^expjiV^y d0eW 
i / # exp { % -$ 2 + V I d<f e(0)/(^ " 0) 



U2 



X 



. (3.3) 
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Let us introduce an order parameter function £(</>), which is normalized 

as 

|e($<ty = i. (3.4) 

Then, using the functional integral of the delta function 

fv({$)I[6(Z{$)-i($)) = l, (3.5) 



we obtain 

N 



(z n ) ~ J va$) J iid^n^cfl -e¥))ae(0)], (3.6) 

i =1 <a 



where 



Q[£(«?)] = exp [iV^ / d<K(0)<? 



x 



1 



d^ exp -V+P / d0£(0)/W-0) 



Moreover, we can utilize the Fourier transform of the delta function 



• (3-7) 



- = / ^(0) exp {2™ | d$c{$){£($) - £(0))} (3-8) 



in order to rewrite (13. 6p as 



<Z"> ~ / D£(0) / Dc(0) exp ^ 2m / d0c(0)£(0) - iVF[c(0)] \ £[£(</>)], 

(3.9) 



where 

iV 



F[c{$)\ = -lln | ftd^ expj-2™ | d0c(0)£(0)} 

1 r JL ^ { 2m r - - - - 

= in y n<% ex p | -^r y d ^ - & 

= -lnjdtpexp^-^JdfcifWf-ip)}. (3.10) 
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The major contribution to the functional integral over c(0) in the limit 
N — > oo comes from the stationary point c*(<j)) satisfying 



j c {2m J d$c($)£($) - NF{c(J)} 



(3.11) 



Hence we arrive at 



= J Vi{$) exp j-iV J d<K(0) ln£(0)} QU$)\- (3-12) 
Let us rewrite (13.121) as 

( Zn ) ~ J^m^ J T>t® ^ (3-13) 

where 



S[£] = ^/d^(0)ln^) + ^/d^(0)<? 
+ a In 



d^exp^ 2 + p / d<f>^)f(iP-<f>) 



(3.14) 



with a = M/N. 

In the limit N — > oo, the stationary point determined by the equation 

S -M = (3.15) 

gives the major contribution. However it is hard to solve it directly. Instead, 
we introduce a Gaussian ansatz 

« EM »(2^ eXp f£}' Im<7 M ^ °. (3-16) 
with a parameter a, and look for a solution of the modified problem 

»3p=0. (3.17) 
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This scheme is called the Effective Medium Approximation (EMA) [T9]. The 
condition Ima(fi') < is necessary to ensure the convergence of the integral 
over 0. 

Putting the Gaussian ansatz into (13.171) and taking the limit n — > 0, we 
find 



00 P -Pn k 



1-u/i-a + a^ — — — / Y\_ (n(xj)dxj) — 

k=0 k - J 7 = 1 1 



1 



0. 



(3.18) 



Let us suppose that a satisfies this equation. Then the spectral density is 
evaluated as 



lim — Im-?-±-\n((Z(n)) n ) 

lim —Re / d$i{M 2 
Ima. 

VT 



(3.19) 



The spectral density can be calculated by numerically solving the stationary 
point equation (13.181) and by putting the solution into (I3.19p . 

We remark that there is another approximation scheme similar to EMA, 
which we call the Dual Effective Medium Approximation (DEMA). Rewriting 
f TZTg]) as 



r M - f % M -* 
(Z n ) ~ J II d V* exp | - 5>. 

k=l \ k=l 



X 



and introducing 



we obtain 

(z n ) 



(2m) an / 2 



M 



exp 



M 



M - r i r - - - 

Jld^fc exp M- / d^fj(^ 
k=l l 2 J 



N 



(3.20) 



(3.21) 



X 



(2yn) an / 2 



d(p exp < -^-<p 2 + ap I dipfj(ip)f(ip ■ <p) 



N 



(3.22) 



As before, introducing an order parameter function rj(ip) satisfying the 
normalization 

■q(ip) dip = 1, 



we can derive 



(z n ) 



(2vri) M ™/2 



Vrj{ip) e NS[ri] . 



(3.23) 
(3.24) 



Here 



-i a 



—a I dip rj(ip) hxr](ip) + — j dipr](ip)ip 2 



+ In 



d(p exp < -^-0 2 + oip j dip rj(ip)f(ip ■ <f) 



(3.25) 



In order to approximately evaluate the asymptotic behavior in the limit 
N — > oo, we again introduce a Gaussian ansatz 



7/ 



DEMA 



1 



12 ^ S ~ 



IP 2 
2lT 



, Im<r(//) < 0, 



(2yrir) n / 2 

where r is a parameter, and solve the stationary point equation 

«9% DEMAl 



dr 



0. 



^3.26) 



(3.27) 



We shall call this scheme the Dual Effective Medium Approximation (DEMA). 

Putting the Gaussian ansatz into (13.271) and taking the limit n — > 0, we 
find 



a — ar 



k=0 



~ e~ ap (ap) 



k\ 



"lI(iH-'-,)<i-'-,: 



1 



0. (3.28) 



If r satisfies this equation, we can write the spectral density as 



lim — Im^-4 In ((^(m)) 71 ) ~ lim — Im,f-% DEMA ] 



Im 

7T 



00 e~ ap (ap) 



E 

fc=0 



fe! 



1 ar — a + 1 
Im 

7T /i 



k r k i 

II (n(x,)dx,) fc 2 

j=i p ' ^j=i x i 
Imr. 



(3.29) 
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Let us suppose that we calculate the spectral density of J = AA T as well. 
Although the exact density of the nonzero eigenvalues of J must be identical 
to that of J, an approximate result can be different. In fact, there is a duality 
relation between EMA and DEMA: the EMA result for J is the same as the 
DEMA result for J, and the DEMA result for J is the same as the EMA 
result for J. 



4 Symmetric Effective Medium Approxima- 
tion 

The approximation schemes so far discussed need numerical treatment of 
the stationary point equations. In this section, we introduce a symmetrized 
scheme of approximation, which we call the Symmetric Effective Medium 
Approximation (SEMA). In SEMA analytic solutions can be deduced, if the 
distribution of the nonzero elements of A is binary. 
In terms of the functions 

i N i M 

£$=*f ^VwE^-fo (4-i) 

3=1 k=l 

(12.181) can be expressed in the form 

N „ M 



1 r iv r m 



j=l k=l 



x exp .V^- J do^{o)o J + M- I d, < //( c)c 2 



x exp |Mp J d^J d<f>f}U>)Z(<l>)fU> • 0)| . (4.2) 
As before it can be further rewritten as 

( Zn ) ~ J^y^l J VaftVvm e NS ^\ (4.3) 

where 

S[C, rj) = - f d0f (0) ln^tf) -a I d^($ In 77 



+ ap [df Uhm{i)f{-t- $)■ (4-4) 
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— * 

It should be noted that one obtains S[£] from S[£, rj\ if one eliminates r](ip) 
from S[£, rj\ using the stationary condition with respect to Alterna- 
tively, eliminating £(</>) from £>[£, 77] yields S[rj\. 

In SEMA we suppose that both of the approximate solutions for £ and 77 
have Gaussian forms 



2 



e SEMA ( ^ = 1 J I SEMA/^ = 1 J 

S ^ (27ricx)"/ 2 P [ 2iaj' ' K ^ J (27rir)™/2 ^ 1 2ir 

(4.5) 

(Imcr(/i') < 0, Imr(/i') < 0). Solving the modified stationary point equations 



<9>S[£ SEMA r/ SEMA ] <9S'[£ SEMA ^ SEMA ] 



da dr 

we find the relations 

„2 



(4.6) 



r x 

1 — ap + apar / dxll(x) = 0, 

J 1 — arx 2 

/x 2 
dxll(x) ~ = 0, (4.7) 
1 — OTX 1 



from which it follows that 



r = ^ + (4.8) 
a 

Using the solution a of (14.71) . as before we obtain the spectral density as 

1 f 1 

p(u) ~ lim — Re / d$£{$)$ 2 = liaa. (4.9) 

n^O Tin J IX 



5 Binary Distribution 

In this section, we calculate approximate spectral densities of the matrix 
J = A T A, employing EMA and SEMA as the approximation schemes. For 
the nonzero elements of the M x N real matrix A, we assume in this section 
the binary distribution 

U(x) = 1 (6(x - 1) + S(x + 1)) . (5.1) 
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In this typical case, the Fourier transform of P(x) is given by 

p(k) = l + jj{cosk- 1). (5.2) 

Namely, we have 

f(k) =cosk — 1. (5.3) 

For the binary distribution (15.11) . the stationary point equation (13.181) for 
EMA takes the form 

00 e~ p r> k 1 

l_ <v _ o+a g__ = . (5.4) 

As we mentioned, we are able to numerically solve this equation. 

Comparison of the EMA solution and the average spectral density of 
numerically generated random matrices (NUMERICAL) is shown in Figure 
1. One can see that the agreement is reasonably good except in the tail 
region. 




10 (-1 20 30 40 



Figure 1: Comparison of the EMA solution (p = 12, a = 0.3) for the spectral 
density and a numerically generated result (average over 1000 samples, N = 
8000). 
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On the other hand, for the binary distribution (15.11) . the SEMA stationary 
point equations (14.71) are written as 

OT 

1 — ofi + ap = 0, 

1 — ot 

OT 

a — ar + ap- = 0. (5.5) 

1 — ot 

Then it is straightforward to derive a cubic equation for o 

a s + Q(P + 1) ~2 j2 _ fia + (1 -a)(ap- 1) ^ + ^ = Q / 5 g \ 
H /i 2 fi 2 

This cubic equation can be analytically solved. Using the notations 

a(p+l) — 2 ua + (1 — a)(ap — 1) a 
«2 = , ai = 5 , ao = -» (5.7) 

for the coefficients, we define 

, ? = i ai_ ^ a 2> r = ^(0102 - 3a ) - ^-ag. (5.8) 
3 9 o 27 

Depending on the value of g 3 + r 2 , the solutions are classified as 

1. If q 3 + r 2 > 0, there are one real and two complex solutions. 

2. If g 3 + r 2 = 0, there are three real solutions (at least two of them are 
the same). 

3. If q 3 + r 2 < 0, there are three real solutions. 

In order to have a nonzero eigenvalue density, we need to have a complex 
solution with a negative imaginary part. Therefore we focus on the case 
q 3 + r 2 > 0. For a complex number z = \z\ e td (— 7r < 9 < n) and a real 
number x, let us define the exponential function as 

z x = | z |x e ix0 (5 9) 

Then, using real numbers 

Sl = _(- r _ ( g 3 + r 2 ) 1 / 2 ) 1 / 3 , s 2 = -(-r + (g 3 + r 2 ) 1 / 2 ) 1 / 3 , (5.10) 
one obtains a real solution 

fl 2 

2: = Si + S 2 -y (5.11) 
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and complex solutions 



1 a 2 .a/3 



1 A2 v3 . 

22 = --{si + s 2 )- — -i— (si-s 2 ). (5.12) 

The nonzero eigenvalue density is thus given by 

1 a/3 

p(/i) = Imz 2 = — (si - s 2 ). (5.13) 

7T Z7T 

This equation gives a continuous band between the edges /i_ and fi + (p_ < 
/x + ), where g 3 + r 2 = holds. 




Figure 2: Comparison of the SEMA solution (p = 12, a = 0.3) for the spectral 
density and a numerically generated result (average over 1000 samples, N = 
8000). 

We compare the SEMA solution (15.131) and a numerically generated result 
(NUMERICAL) in Figure 2. In spite of the simplification of the scheme, the 
agreement is still reasonably good. However, as the SEMA spectral density 
vanishes out of the edges /i_ and p + , the discrepancy in the tail region stands 
out. 
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0.0012 
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Figure 3: Comparison of the EMA and SEMA solutions (p = 12, a = 0.3) 
and a numerically generated result (average over 1000 samples, iV = 8000) 
in the neighborhood of the outer edge /i + = 32.611. 

In Figure 3, we compare the EMA and SEMA solutions and a numerically 
generated result (NUMERICAL) in the neighborhood of the outer edge 
One can see that the EMA solution has minibands out of the outer edge, 
which approximate the tail spectrum of the numerical result. On the other 
hand, the neighborhood of the inner edge /x_ is depicted in Figure 4. The 
EMA solution also has minibands within the gap between the origin and the 
inner edge. 

6 Single Defect Approximation 

In SEMA, the spectral density vanishes out of the edges //_ and There- 
fore, in order to analyze the tail region, we need to improve the approxima- 
tion. Let us begin with the definition (14.41) of S[£, rj}. The exact stationary 
point equation can be derived from the variational equation 

5 V ] + a (| d$ - l) + b (y diJ r)$) - l) } = (6.1) 
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0.02 




1.5 |^ 



Figure 4: Comparison of the EMA and SEMA solutions (p = 12, a = 0.3) 
and a numerically generated result (average over 1000 samples, N = 8000) 
in the neighborhood of the inner edge //_ = 2.087. 



as 



SS[£,y] 
5vW 



+ a = -lne(0)-l + ^0 2 + ap/d^^)/(^-0) + a = O, 

-> ia f ->->-> -> 

+ b = -a In r/O) - a + y^ 2 + ap J &<f> £(<f>) f (xj) ■ 4>) + b = 0. 

(6.2) 



Here a and b are the Lagrange multipliers which ensure the normalizations 
of £(0) and rj(ip). Then we find 



f (<£) = A exp 

— * 

rj{ip) = B exp 



—(f) +ap I dip r}(ip)f(ip ■ 4>) 



^ 2 +p/d0£(0)/O-0) 



(6.3) 
(6.4) 



where A and B should be determined so that £(0) and t](ip) are correctly 
normalized. 
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We have so far made no approximation. Now, as the first improvement 
of SEMA, we put the Gaussian ansatz 



(2nir) n / 2 



exp < — 



2ir 



Imr(p') < 



(6.5) 



into the RHS of (16.31) and calculate the LHS. Then, assuming that r is the 
solution of SEMA, we obtain the improved approximation for £(</>) as the 
LHS. This approximation scheme is called the single defect approximation 
(SDA) USED]. 

For the binary distribution f)5.ip . it follows from f(k) = cos/c — 1 that 



A 

k=0 

00 e~ ap {ap) k 



k\ 



dip rj(ip) cos(ip ■ 0) 



A:=0 



jfe! 



cxp 



x2 



~{p' -kr)<j) 



(6.6) 



Now we are able to determine the normalization constant A. Integrating the 
both sides of the above equation over 0, we find 



„ oo 
J k=0 



e- ap (ap) h 
"jfe! 



Ztt 



-n/2 



(6.7) 



Hence A should be set to 1 in the limit n — > 0. Then the spectral density 
can be evaluated as 



pip) = lim— Re Unm 2 

Tin J 

1 ~ e- a P{ap) k 
= hm — Re } ■ 



1 



7T 



Im E 



fc! 

e~ ap (ap) k 



exp 



-(/,' - fcr)0 2 



1 



k=0 



k\ p' — kr 



(6.8) 



Out of the edges p_ and p + , the SEMA solution r(p) is real. Therefore the 
spectral density f)6.8p has delta peaks 



e~ ap (apy 
jfe! 



1 - kr'(p k ) 



5{p - p k ), 



(6.9) 
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where satisfies the equation 

Hh-kT(fi k ) = 0. (6.10) 

Let us note that the imaginary part of er(/x + it) and r(/i + it) cannot be 
positive (see (14. 5ft ). This means that 

hna(fx) < (6.11) 

or, if Imer(/i) = 0, 

Re^<0, Re^ = iRe%^<0. (6.12) 

When fj, is larger than the outer edge /x+ of the band, the solution z\ sat- 
isfies these conditions. The locations of the delta peaks are thus determined 
by solving the equation 

jizM + a- 1 
a — k = 0, « > // + . (6.13) 

a 

For example, if p = 12 and a = 0.3, the locations of the delta peaks are 

H = 32.667, 32.926, 33.336, 33.856, 34.456, 35.118, 35.828, ■•• , (6.14) 

corresponding to k = 14, 15, 16, 17, 18, 19, 20, ■ • • (jjt+ = 32.611). We would 
like to note that the DEMA minibands (not shown) seem to appear around 
these delta peaks. 

From the analytic solution (15.121) . we find the asymptotics 

Zi(fi) ~ — , fi — > oo, (6.15) 
H 

from which it follows that 

fizM + a- 1 
r(/i) = ~ 1, u — > oo. (6.16) 

a 

Thus the delta peaks are located at ~ fc, so that a continuous approxima- 
tion gives 

e~ ap (ap) k 

p(Vk)(Vk ~ l*k-i) r, • (6-17) 
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Therefore, in the limit of large /x, we obtain 



e -ap 

M ~ exp 



— /i In 



ape 



(6.18) 



A similar asymptotic formula is known for real symmetric sparse random ma- 
trices R whose elements Rji (j < I) are independently distributed [HI \W\ . 
As argued in [T5], SDA is expected to be correct for large fi. However, the 
weights of the delta peaks (16.91) are too small to account for the numerically 
calculated cumulative density. In order to improve the agreement, we pre- 
sumably need to develop higher order extensions of SDA by iterating the 
approximation scheme. 

When fi is smaller than the inner edge the solution z 2 satisfies the 
conditions (I6.12p . However, as fxz 2 + a — 1 < 0, there is no SDA delta peak 
in this region besides at the origin. Therefore the second order extension of 
SDA should be applied. Assuming that a is the solution z 2 of SEMA, we put 
the Gaussian ansatz 



into the RHS of (16.41) . Then rj is calculated as the LHS of (16.41) and put into 
the RHS of (16. 3p . Thus the LHS of (16.31) gives the approximate solution for 
£(</>). Within this approximation, an argument as before yields an equation 

"-£i=/£m = °- "<"-• (6 - 20) 

which determines the locations of the delta peaks. Here nj, are non-negative 
integers. For example, if p = 12 and a = 0.3, we find the delta peaks at 
fi = 1, 1.6, 2, 2.035 besides at the origin (//_ = 2.087). 



7 Summary 

In this paper, we evaluated the asymptotic eigenvalue density of the matrix 
of the form J = A T A, where A is an M x iV real sparse random matrix. 
We utilized replica method and developed approximation schemes called the 
Effective Medium Approximation (EMA) and the Dual Effective Medium 
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Approximation (DEM A). Moreover a symmetrized version of EMA (SEMA) 
was presented. In the case of binary distribution of the nonzero elements of 
A, analytic solutions were derived for SEMA. We compared the results of 
EMA and SEMA, focusing on the behavior in the tail region. In order to 
analytically improve SEMA, we further developed the Single Defect Approx- 
imation (SDA) and evaluated the tail behavior. 
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